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A DESCRIPTION AND A COMPARISON OF CERTAIN NONLINEAR 
CURVE-FITTING TECHNIQUES, WITH APPLICATIONS TO 
THE ANALYSIS OF TRANSIENT -RESPONSE DATA 
By Marvin Shinbrot 

SUMMARY 


Several common methods for curve fitting a set of data by least 
squares are described and evaluated. The methods are evaluated by 
applying them to an example taken from aerodynamics: the problem of 
calculating the stability parameters of an airplane from flight data. 

There are other points considered: application of the methods to 
minimization problems other than curve fitting and the question of con- 
vergence to a mere stationary point as opposed to convergence to a 
minimum. 

Finally, several devices -which lead to more rapid convergence of 
the methods are discussed. , 


INTRODUCTION 


In the determination of stability parameters from flight data by 
the analysis of transient responses the use of a least-squares process 
has been suggested (references 1 and 2). If the elevator of the test 
airplane Is pulsed. It Is shown in reference 2 that the response in 
pitching velocity Is a nonlinear function 1 of the stability parameters; 
the pitching velocity is a sum of exponentials, where the exponents and 
the coefficients of the exponentials are c omb inations of the stability 
derivatives of the airplane. It Is one of the purposes of this report 
to show how the stability parameters of an airplane may be calculated 

1 The expression "nonlinear function" as used in this report should not 
be confused with nonlinear functions (i.e., functions satisfying non- 
linear differential equations) usually considered in aeronautical 
problems. The expression is used here in a different sense; when it 
is said that the pitching velocity is a nonlinear function of the 
stability parameters, it is merely meant that the pitching velocity 
cannot be expressed as a simple sum of the stability parameters 
multiplied by constants . 
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from flight data by means of least- squares curve-fitting techniques. A 
simple least-squares solution of this problem is given by Prony’s method, 
by which a set of data may be fitted to a sum of exponentials (refer- 
ences 1, 2, and reference 3, pp. 369-370). There are many objections 
to this method, however, foremost among these being the fact that 
examples have been encountered for which Prony’s method fails entirely. 
Further examples have been met for which Prony’s method, while giving 
an answer to the problem, did not yield a good fit for the data. In- 
general, therefore, when fitting a sum of exponentials, Prony’s method, 
when it works at all, may best be considered to give only a first 
approximation to the desired parameters. 

The process of curve fitting a nonlinear function by least squares 
may be applied to a wide field of engineering problems and not merely 
to the calculation of stability parameters. For this reason, the pres- 
entation of this report, is such that the methods described may be 
applied to any reasonably smooth functions (say, functions which are 
twice continuously differentiable). Emphasis, however, is placed on 
sums of exponentials, since. the occurrence of such functions is quite 
common and since they are believed to be representative of the entire 
curve -fitting problem. 

The general problem has many possible solutions, the classical one 
being the use of-a Taylor’s series with all termsofjorderhigher than 
the first omitted In order to iterate from the first approximation 
(reference 2 and reference 3, p. 21k ) . In recent years, however, 
powerful new methods have been devised (references 4, 6, 7, and 8). 

It is the general purpose of this report to. collect these methods under 
one cover and to apply a relative evaluation to them by using them to 
solve the same representative problem. The criteria which will be used 
for this evaluation are the relative amounts of labor involved and the 
rate of convergence of the iterations. 


ANALYSIS 

Relation of the Problem to Aerodynamics 


It is shown in reference 1 that if q(t) is the response in pitch- 
ing velocity of an airplane to an elevator deflection 5(t), then q(t ) 
and 5(t) are related by the differential equation 

(D 2 + bD + k)q(t) = (CiD + C c )&(t) (l) 

where D is the operator d/dt; b, k, C x and Co are constant 3 , depend- 
ent on the stability derivatives of the airplane. The problem which 
then arises is that of determining the best values ("best” to be defined 
in the sequel) of these constants, being given graphical representations 
of q(t) and S(t) obtained from flight data. This problem is solved in 
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reference 2 by fitting q.(t) to a function of the form. 


<1 = 


Ai + ClXl+C <? . f e“ XlT 5(r)dr 1 e** 6 + 
A1-A2 Jq 


•which is the general solution of equation 
and A 2 represent constants depending on 
(Dq.)t=oj and. &(0), while \ x and \ 2 are 
tic equation x a + bx + k = 0. 


A 2 + s“ X 2 T 5( T )dr]e 

\ S -X 1 J J 

( 2 ) 

(l) . In equation (2), At 
the ini tial conditions q.fo), 
the roots of the characteris- 


X 2 t 


The method used in reference 2 (herein called the Taylor’s series 
method) is described in reference 2 and in reference 3* page 21k. It 
consists of finding a first approximation to b, k, and C Q by seme 
means and then using a Taylor’s expansion, with all terms of order 
higher than the first omitted, to linearize q_ and iterate to the best 
values of the desired constants. It is the object of this report to 
describe- and evaluate other methods as well as the Taylor’s series method 
for fitting nonlinear functions such as the one given in equation (2) . 


If the input 6(t) is of the pulse type, that is, if there is a 
T such that 5(t) = 0 for all t T, it follows from equation (2) 
that for t ^ T, q(t) is a sum of exponentials with constant coeffi- 
cients: 

q.(t) = B 1 e X ' lt + B 2 e^ 2 ^ (3) 

where B x , B a , X x and X 2 are constants. The methods described in this 
report will be applied to the nonlinear function Bj^e^ 1 ^ + B 2 e^2 t since 
this function is considered to be representative of the general type of 
problem found. That is, an evaluation of the different methods for fit- 
ting nonlinear functions based on the application of the methods to a 
function of this form is believed to be generally valid. A second (and 
perhaps more Important) reason for choosing a sum of exponentials to use 
as an example is the frequency with which problems involving these func- 
tions themselves occur. 


Statement of the General Problem and Its Specialization 
to Sums of Exponentials 

To formulate the problem precisely, suppose q.(t, x x , x 2 , ... , xju) 
Is some nonlinear function of the independent variable t and the (con- 
stant) parameters xi. Let q. e ( t) be a quantity which is measured at a 
set (tij , i=0, 1, ... , N of N+l values of t. It is then desired to 
find the best values of the parameters x^, that is, those values which 
minimize jj 

M = ^ [q.(ti) - q.gtti)] 2 (k) 

I=o 
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The problem specifically studied in _ this report is the following: 

Let - - ' ' ' ' • ~ 

q(t> = B ie Xlt + • ' • ( 3 ) 


where Bj., Bs, \ 1} are written instead of x^, x 3 , x*, and 

suppose qg(t) is a measured quantity which, theory tells us, should 
satisfy an identity of the form (3). The data q e (t7 are subject, how- 
ever, to experimental error.' Let q € (t) be measured at the N+l points 
to > ti, ... , tjj. The problem then becomes that of findin g values of 
the constants B s , X x , and \ s such that 


W 

«-Y 

Z_l 

i=o 

is a minimum. 


B ie Xlt i + B 2 e X2t i - ^(ti) 


(to) 


In general, data which fit a sum of two exponentials are oscilla- 
tory; that is, the plotted data have the appearance of a damped sine 
wave. If this iB the case, Xs, B^ and B e are complex numbers and, 

if = l+l * i and Bi = i({3 + 0*i), where i 2 = -1, then \ P = l- VI, 

B 2 = i(a _ 3'i) and . ", 

q(t) = e H (0 cos l ' t - p’sin 2»t) ( 3 a) 


It— is more convenient to work with q(t) in this form than in the com- 
plex form ( 3 ), Applying this notation to equation, (its), we obtain, 
finally, 


M = 


I 


i=o 



Z’ti_- p'sin Z*tj_) 


leC'fci) 


~|S 


(to) 


which must be minimized. 


The Iteration Methods 


It is now assumed that by some means (Prony’s method may usually be 
used for sums of exponentials) a first approximation to the parameters 
has been found. What follows is a description of the methods which may 
be used to improve these values. ' 

Steepest descent methods.- In order to be able to apply a geometric 
interpretation to the .usual steepest descent method, it is first assumed 
that the quantity M to be minimized is a function of only two param- 
eters, x and y (x and y being here written instead of x x nr)ri 
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because of the profusion of subscripts .which will soon occur). The 
* obvious generalization to more parameters will then be presented. Sup- 

pose a first approximation (xq, yo) has been found. Let the values of 
the parameters at which M is a minimum be § and T} . Further, let 
Mq, MjcqJ My Q , MxqXq^ Mjcoy-Q’ 811(1 *Iy 0 y 0 1)6 values of M 811,1 il;s 

indicated partial derivatives at the first approximation, and let |j. be 
the value of M at (|, tj). Suppose the surface M = M(x,y) is plotted 
as in the ‘following sketch: 





Sketch (a) 


Consider now the level curve Ci, which is the intersection of the sur- 
face M = M(x,y) and the plane M = Mo. Let Q be the point (xo,y 0 . 

Mo), and consider also the curve C 2 which is the intersection of 
M = M(x,y) and the norm a l plane to Ci at Q. The direction of steepest 
descent from the first approximation Q is the direction of the gradi- 
ent of M, that is, the direction of the curve C 2 at the point Q 
(reference 9* PP- 76-78)- The minimum P of C 2 is taken as a new 
approximation to (5,tj,ji) and the process is repeated. 

In order to find the coordinates of P, project the normal to the 
level curve C x at (xo,y 0 ,Mo) onto the (x,y) plane, and let n be 
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Sketch (b) 


the distance- of an arbitrary point 
on this projection from the point 
(xo^yo^O)- A coordinate system has 
now been introduced in this (M,n) 
plane. (See sketch (b).) 

In this plane, the curve C 2 
has some equation M = M(n). By 
Taylor’s theorem, 

M = Mq + An Mnn (5) 

approximately, where M n and M m 
are the values of the indicated 
derivatives at the first approxima- 
tion .Q, and An denotes a change 
n in the coordinates (x,y) in the 
direction of the normal to Ci. An 
approximation to P is to be had 

by setting = 0 in equa- 

d(An) 

tion (5) • This procedure leads to 


An = - 

Mnn 

This value of An corresponds to certain increments Ax and Ay. 

It is these increments which are sought. What follows are manipulations 
which are needed for their evaluation. 

If (n,x) and (n,y) are the angles between the n axis and the 
x and y axes, respectively, then 
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Mq — grad M [ = »J Mxq 2 + My 0 ^ 


(8) 


It is also clear that 


cMn dx SMh dy 

' ST S + W to 


(9) 


Finally, expressions for dx/dn and dy/dn must be found. The normal to 
the level curve Is the intersection of the two planes 

y - 7o = - (^~) (x - Xq) and M = Mq, where dx/dy is the reciprocal 

of the slope of the curve Ci in the plane M = Mq. From this last 

/ \ dx My-. 

equation (M - Mo) , it follows that — The equations of the 

dy Mxo 

n axis of the (M,n) plane in the space (M,x,y) then become 


y - yo = ^ (x - xo) 1 
Mxq 


M = 0 


M- 


Consider a point (x,y) on n. Then y - y 0 = (x-xo). By the 

Mxq 

definition of n. 


n 


- /f- 

/VMxo 


(x-Xq) + (x-xof 


( X— Xq ) Mxo S + M yo 2 


M- 


Xb 


or 


x = 


eMxq 


J Mx ^ 2 +'Mv 3 


Vo 


Mxo 

+ Xo = n - — + Xo 

Mn 


Similarly, 


nM- 


y = 


•yo 


ys 


+ %0 S 


+ yo 


= n ^ + 


M r 


yo 


Therefore 
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Returning to equation ( 9 ), it then follows that 


M, 


L nn ~ 


= (MxqMxqXq + Myo^yp) Mxq ( M Xo M Xoyo + M y 0 M y 0 y 0 ) M y 0 
Mn _ _Mn. Hq. Ha 


Thus finally, utilizing equations (6), (7), (8), and (9a), 

Mxq(M X o 2 + My Q 2 ) 

MxoCMxqMxoXo + MyoHxbyo) + M y 0 ( M x 0 M x 0 yo + M yo M yoyo^ 


Ax = - 


Ay = 


M y Q ( M Xr. 2 + %Q 2 ) 


M xo( M XoMxoXo + M y 0 Mx oyo^ + Myo^^^oyo + M yo M yoyo) 


(9a) 


(7a) 


which are the desired values of the increments for the case of two 
parameters . 

These equations will now be generalized. Suppose then that M is 
a function of the - m parameters Xj., Xg , ... , xjh. Let Mo, Mi 0 denote 
the values of M and SM/dxj, respectively, at seme first approximation. 
Equations (8), (9), and (9a) become 


Mr 


grad M 


'■( 


m 


M io7 




t=i 


(11) 


m. Aj Ml o^Jo^loJo 

mu, =. y iiia. 

1 dxi 8n 
i=l 


Mn £ 


and equations (7a) become 


Axk = - 


m 



( 12 ) 


(13) 


i,J=i 

In practice this method would seldom be applied directly to a first 

approximation. Rather the rougher approximation An = - — , which will 

M n 

herein be called the method of steepest descent along a tangent, after 
Booth (reference 4) , would be used until the value of M begins to 
increase. In terms of - the individual increments, this method leads to 
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Ax k = 


MpMko 



(14) 


Another steepest descent method, one which utilizes quadratic 
interpolation, was developed by Booth in reference 1*-. As before, call 
M 0 the value of M at the first approximation. Calculate increments 
from equations (14). Call Mi the value of M at the new approxima- 
tion obtained by adding these increments to the first approximations. 
Further, let Mi/ a be the value of M at the parametric values 
obtained by adding to the first approximations one-half the increments 
found from equations (14). The increments which Booth finally uses then 
became 


Ax k = - 


Mi - l)Mi/ a 4- 3Mp 

_ 4(Mi - 2Mi/a + Mo) 


^oMko 

m 

I Ml ° 2 

i= 1 


(15) 


The formulas which have been derived will now be explicitly given 
for the case where q is the sum of two exponentials; that is, the 
case where 



i=o 



cos l't± - 




sin Z*ti) - q e (t ± ) 


(4b) 


Let Mo, Mj 0 , M 2 ? 0 , Mp Q , and Mp» Q be the values of M and its deriva- 
tives at the first approximations. Then, 


Ma 2 = M Zq 2 + M Z » 0 2 + Mp 0 2 + Mpt c 2 (8a) 

The method of steepest descent along a tangent gives the incremental 
values 


A Z 
AZ» 

AP 


MoMj 0 -n 
Mh 2 . 

MoMzt 

Ma^ 

MqM(3 0 




MoMp'o I 
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These increments must be added to the corresponding first approximations 
to obtain new approximations. This process is then repeated until M 
increases. The parametric values which gave- the sma llest value to M 
are then used as first approximations, and one of the finer methods is 
applied . 


For the ordinary method of steepest descent to a minimum, equa- 
tions (13) became 


A2 = - 


A I* - - 


M2o 

Mrm 

MVp 

Mnn 


Mnn 


A3 


. _ M 3*o 

Mnn 


where M nn is given by 






(13a) 




Mnn « 7^2 IM Zo 2 M Zo z 0 + + Mp 0 2 Mp 0 p 0 + M^Mp*^ + 2(M Zo toyii 0 * 0 + 


MZqMpqMZoPq + MzoMp^Zoffc + M Z , 0 M Po M ^oPo + M *o M &> M io& + M Po M & M Po&) J 

(12a) 

The quantity M n is displayed in equation (8a) . All the derivatives in 
these equations are to - be evaluated at the first approximations. 


Finally, Booth's method gives 


Al = - F 


A2» = - F 


MqMz 0 

Mn 2 

MpMzb 

Mn 2 


-\ 


Aa _ p MoMPo 


AP* = - F — g 


MoMp^ 
1 




(15a) 
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where . . . 

F = Ml - ^1/2 + 3 Mq 
MMi - 2M 1/a + Mq) 

Mi, Mi/ 2 and Mq are as defined previously. 

For later use, the derivatives needed for these methods are given 
below. Let 

£i = e Jti (fJ cos Z’ti - p* sin Z*ti) - ^(ti) 

Then 


N 


■I 


M = > e ± - 

i=o 


(kb) 


and 


Mi 


Mjt 


Mr 


M p , 


N 

= 2^ eitie Jti (p cos Z*ti - p* sin Z'ti) 


i=o 


N 


V Zti 

= - 2 ) eit^e (p sin l*ti + p’ cos Z'ti) 


i=o 


N 

-I 


lt± 

2 ) eie cos l*t± 




i=o 


^ Zti 

2 ) e±e sin Z’tj 
i=o 


(IT) 


J 
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The second derivatives are 


Mjj = 2 "S'" ■b^e^'^p cos sin l*t^) X 


i=o 


[e^ + e^^(p cos Z*tj_ - p* sin 


F 

Kpit- 2 ^ [tj_e iti (p sin I’t^ + p* cos Z’ti)] 2 - 


i=o 


N / ( l8 ) 

2 X , e i ti 2 e^ ti (p cos Z’t^ - p' sin Z’tjJ 
i=o 


Mpp 


(e 


Zti 


cos 


Z‘ti) 


i=o 


Mp-p* 



(e^ 1 sin Z’ti) 2 


i=o 


J 


while the mixed second derivatives are given by 
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Mzz»- - 2 ^ ti 2 e Zt i(p sin Z»ti + p» cos Z»ti) X 
l=o 

fe i + e 1 (( 3 cos Z*ti - p» s in 2*ti)] 

M JS - 2J H.ltl = os l. tl [ Sl + ««!(* =0B j, tl . s , Bln 




. 1=0 


rr 

M Zp‘= - 2 ^ tie Ztl sin 2*ti[ el + e zt i( p 


l=o 


cos 2‘ti - p* sin z»ti)] 


N 


■ " z l €itieZti sin i,t ± - 2 y (t ie zti cos z *t ± ) x 
1=0 1=0 

[e Zti (p sin Z»t ± + 0’ cos Z'-fc-jJ] 

Ml'S- = 2^ sin l't ± ) [e“i( B sto j. tl + s . c08 , tt±) ] 


(19) 


i=o 

IT 

I 


Zti 


2 ) e itie " '‘■ L cos Z»ti' 
i=o 




Mp pf = - 2 (e 1 cos Vt ± )(e ltl sin Z*t ± ) 
i=o 
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The relaxation method. .- An excellent geometric interpretation of 
the relaxation method in its application to the solution of sets of 
simultaneous linear equations may be found in reference 5. The formulas 
required for the solution of the problem posed in this report are 
derived In reference 4. .~ 

Suppose M, the quantity to be minimized, is a function of the m 
parameters x L , >u , . . , , Xj^. Assume further that some approximation 
to those values of the parameters which minimize M "has-been found. 
Holding all these variables save one (say, x k ) constant at these approx- 
imations, M becomes a function of. x k and, applying Taylor’s theorem, 
we obtain _ 

M ■ Mo + Ax^Mko + 

using the same notation as before. For M to be a minimum, 
dM _ <3M 

rj— must be zero. That is, ■ ■ 

dx k d(Ax k ) 

Ax k = - (20) 

*** 0*0 


As for the question , of which of the m parameters to vary, 
Southwell (reference 6) suggests finding the increment Axt in that 
variable x^ for which | is largest. Synge (reference 5) varies 
Xfc, where k is determined as that index which makes | /M^^o I 

largest. Synge’s method has the disadvantage of requiring the computa- 
tion of all the second derivatives Mj^v at each iteration. For this 
reason, Southwell’s method will be used in this report. 


If the data are to be fitted to a sum of two exponentials, M 
is given by equation (4b). The derivatives needed for the application 
of " the relaxation method are displayed in equations ( IT ) and (l8). 


The first step in the application of the- relaxation method is the 
calculation of all the first derivatives of M to ascertain which has 
the largest numerical value. If (say) is the largest of the first 


derivatives, then l ib changed by an amount AZ 


M 


lo 


MZqZo 


Similar 


formulas are used for the other parameters. 


The Taylor’s series method .- This method is described in detail in 
reference 2. The essential formulas may be easily derived, however, 
and they will be duplicated here. 

Suppose, as before, that q is a function of the m parameters 
x x , x 2 , ... , % and the independent variable t; ‘ 
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q. = q.(t, x lf x s , ... , %) (3b) 

Letting zero subscripts denote the value of the indicated quantity at 
the first approximation, and applying Taylor’s theorem, it may be seen 
that 


m 

(|jj) 

k=i 

where Axk = xk - (xk) Q . In the Taylor’s series method, M is not 
minimized. Rather, the minimization procedure is applied to the approx- 
imating function 



This minimization leads to the set of (linear) simultaneous equations 


If 


then 


c!M 


0 , 


k = 1, 2, . . . , m 


d(Ax k ) 

q = e Jt (p cos Z’t - p’ sin Z’t) 


-\ 


= te lt (p cos Z’t - P’ sin Z’t) 

= - te Zt (p sin Z’t + p» cos Z’t) 

dZ« 

— = e^ cos Z’t 
dp . 

= - e J_b sin Z’t 

sp’ 


( 21 ) 


(3a) 


( 22 ) 


These derivatives are reproduced here for use later. 


The method of damped least squares and the problem of increasing M . - 

It may sometimes occur that the least-squares processes which have thus 
far been described may fail to converge. Upon applying the Taylor's 
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series method , for example, increments may be found -which, although 
diminishing M (equation (4c)), may cause M to increase. A proce- 
dure which may be tried when one method, fails is to apply one of the 
other methods, as failure of one method for a particular example does 
not imply failure of all the others. 

Levenberg (reference 7) suggests a different procedure, which he 
calls the method of damped least squares. In order to keep the incre- 
ments small, he minimizes 


M« 


wM + 


m 

I 

k=i 


wk(Axk) ‘ 


(4d) 


where M is given in equation (4c), while w and wk are weighting 
factors. A more general procedure than this would be to minimize 


M" 


m 

uM + 

k=i 



w k (Ax k ) 


a 


(4e) 


by any of the methods previously described, where M is given by 
equation (4). 


Completion of the Aerodynamic Problem of the 
Calculation of Stability Parameters 


It was stated in the first- section of this report that an aero- 
dynamic problem to which the methods herein described are applicable is 
that of determining the stability coefficients, b, k, C x and C Q , of an 
airplane. These parameters are constants which occur in the differential 
equation (l) relating pitching velocity with elevator input. This 
report has not as yet shown, however, how these constants may be deter- 
mined} rather it has been ^hown how the four other numbers Z, Z', 0, 
and 0* may be found. It is the purpose of this section to describe the 
means by which b, k, Cj and C 0 may be calculated from the knowledge 
of Z, V , 0, and 0* . 

The constants b and k may be Immediately computed from the 
equations 


b 

k 


- 21 
Z 2 + Z' 



( 23 ) 
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In reference 2, it was shown how the constants Ci and C Q may be 
found. However, the quite valid objection that the method weights the 
initial conditions 2 q(o) and q(o) too heavily can be raised. Not only 
is 4(o) heavily weighted, but it is also true that it is difficult to 
calculate the derivative q(o) at all accurately. The method described 
below does not involve the calculation of q and also, instead of being 
entirely dependent on the value of q at the initial point, applies a 
simple least-squares procedure to all the points at which 6(t) is not 
yet zero to calculate C x and Co- 

Ref erring to equation (2), the following notation will be used: 




i T S( t)1t = at - at*i 



It is clear, then, that 




XaT 6(T)dT = a k + cr k *i 



where 


Also, 




S A dot is here used to denote differentiation with respect to t. 
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If the input 8(t) is a pulse which is zero for all t -i tj, then, 
for tk > tj, 0 k and ok» are constants. Let 


0 


0»i 



e“ XlT 8(T)dT 


Thus, 0^ — 0 and 0 k f =» 0 * for all t k ^ tj. Further, for all t^ ir ty, 

Q.C't'k) = e ^ k (P cos 2 ,- tk “ P* ®i n z,-fc k) (3a) 

Thus, by comparing equations (3a) and (3c), since a, a*, p, and p* are 
constants , 

, p _ ( 2 * 0 - 10 * )Ci - 0 'C Q 

Z» 


a » „ p. + 

V 

and, substituting into equation (3c), 


o(tv) - eMTa - - °’Co + - ffl L'Ja' 

ll i* i*._ 


COS Z*tk - 


p , (Z , 0 , +Z 0 )Ci + oCo _ ( Z ^Ck^+Zok)^! + ckPo 

V Z * 


sin Z 


'**} 


Replacing q(tk) by q e ( tk) , it may be found that the following equation 
is approximately true: 


It- 


Ztk 


(c^OkQe cos Z»tk - ( 0-0k)e sin Z*tk 


Z* 


Co 


[Z^c-Ok) - Z(0 t -0k t ) je^^cos Z ? tk + [Z t (0 , -0k t ) + Z(q-0k) je^^sin Z f tk 


Z» 


= l e (tk) - eZt (P cos Z’ tk - p' sin Z’tk) 


( 25 ) 


Equations (25) are a set of (j+l) linear equations (for k = 0, 1, ..., j). 
Since Z, Z', p, and p* are known, equations (25) may be solved by the 
ordinary method of least squares for linear equations (reference 3) for 
Gi and C Q . 
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APPLICATION TO AN EXAMPLE 

The First Approximation and the Method of Steepest 
Descent Along a Tangent 


The example to which all methods described in this report will be 
applied is actual flight data obtained by measuring the pitching veloc- 
ity of a test airplane in response to an elevator pulse which was zero 
for all t 0.4 (t = 0 being taken at the start of the pulse). These 
data are given on this page. 

Since q e (t) is oscillatory, the exponents Xl 
must be complex, and if X* = 2 + 2’i and 

Bi = |(p+p»i), then x 2 = 2 - 2’i and Bg = |(0 - 0»i). 

Furthermore, q(t) and M are as given in equa- 
tions (3a) and (4b), respectively. 

It is now assumed that a first approximation 
to the parameters has been found. Prony’s method 
(references 1, 2, and reference 3, PP* 369-370) 
was applied to the data in the table on this page 
giving, if zero subscripts denote the values of 
the indicated parameters at the first approxima- 
tions. 


( 26 ) 


In many examples which occur in practice, 
the first approximations which have been found 
may be rather rough, and a rapid method for 
improving these values before applying any of 
the finer methods described previously is 
desirable. Such a method has been described 
in the section on steepest descent methods 
where it was called the method of steepest 
descent along a tangent. If Mo, M j Q , Mj»q, 

Mp Q , and Mp»_ denote the values of M ana 
its indicated partial derivatives at the first 
approximations found above, and if 

M n a = Mj/ + M z , o a + Mp a + Mg,/ 


2o = - 1,1660 
2 0 t = 3.2700 

Po = . 4616 

P 0 * = -.2450 
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then it was shown in that- section that the values of the increments 
from which new approximations may be obtained are 


Al = 


MpM Zo 

Mn a 




AZ* 


MqMZ» q 

M]2 S 


A? 


MpMp Q 

Mn 2 




(llta) 


, _ _ 

■ V 

J 

This method is applied repeatedly until the value of M increases. The 
values of the parameters which gave the smallest value of M are then 
used as new approximations to which are applied one of the finer methods. 


The method of steepest descent along a tangent is applied to the 
data of this report in table I. Referring to table I and letting cir- 
cled numbers refer to columns, it may be seen that 

Mo = 2 @ E - 0.0028 
M2 0 = 2 S @ x @) = 0.0105 
Mz* o = - 22 @ x @ - 0.009U 
“po ^ 2 2 (D X @ = 0.000246 
M P‘ 0 = -2E @ x @ = 0.000585 

Thus, 

Al = -0.1500 
A V = -.1307 
Ap = -.0035 j 
Ap» = -.0084 

The new values of the parameters are then 

l = -1.3160 
l* = 3.1393 
p = .4581 

P‘ = -.2534 


(26a) 
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Using these values of the parameters as first approximations, it 
is found that the value of M corresponding to these values of param- 
eters is 

M - 0. 008072 

■which is larger than the value of M corresponding to the parameters 
found by Prony's method. The implication here is that the first approx- 
imations found above were good. In general, however, it has been found 
that these approximations are not so fine and that several applications 
of the above method are required before M begins to increase. It 
should be noted that the increase in M‘ does not imply that the value 
of each parameter given by equations ( 26 ) is better than the correspond- 
ing value displayed in equations ( 26a) . It merely implies that over the 
entire range the curve obtained from the parameters ( 26 ) fits the data 
better than does the curve corresponding to the parameters ( 26 a). 

Since the value of M obtained after an application of the method 
of steepest descent along a tangent was larger than the value corre- 
sponding to the values obtained by Prony's method, the methods will be 
applied using the parameters obtained by Prony*s method as first 
approximations . 


The Method of Steepest Descent to a Minimum 


The method of steepest descent to a minimum is applied in tables I 
and II.' The first 19 columns of the calculation are Identical with the 
calculations needed for the method of steepest descent along a tangent 
which are displayed in table I. The remaining columns and the sums 
which are required are shown in table II. 

It follows from equations (lib) , (17) > (l8), and ( 19 ) that if cir- 
cled numbers refer to columns, then 
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Mq = £ @ 2 * 0.0028 
Mj 0 = 2 E @ X @ = 0.0105 
M z t 0 = -2E @ X @ - 0.009H 
M po = 2 £ (D X @ = 0.00021+6 
M p , o = -2E@ X @ = 0.000585 
Mj 0 Z 0 - 2 £ @ X @ « 0.1+097 
M = 2S @ 2 ’2S© X® - 0*3928 
M PoPo - 2 £ ® S = 1.291 
MpbP’o“ 2 £ ® 2 = 2.1+87 
Ml 0 Z»o - - 2 £ 0 X @ = 0.03107 
M*oPo " 2 £ @ X @ - 0*5665 





Mz 0 p« 0 = - 2 £ @ x @ * -0.3231 

MZbp 0 = -2£@X@-2£@x@ = 0.3960 
MZ’oP’o »2£@ X @ - 2 £ @ X @ - 0.7898 
M PoP’o " - 2 £ ® X ( 9 ) " 0 • 2l +!+5 


Applying equations (8a), (12a), and (13a), it may be seen that 

A l = -0.0217 
AV = -.0188 

> 

Ap = -.0005 

AP’ = -.0012 

> 

or, applying equations (26), that “the nev approximations to the param- 
eters become 
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lo - -1.1877 
l'o = 3.2512 

3o = • 4611 

p* Q = -.24fc2 


Booth's Method 


Booth's method is applied in tables I, II, III, and IV. Applying 
equations (15a) and (l6) and the sums found in tables II, III, and XV, 
it may be found that 


F = 0.1419 


or that 


A l = -0.0217 
AZ* » -.0188 

> 

Ap * -.0005 
A0* » -.0012 

Finally, it follows that the new approximations are 

Z 0 = -1.1877 

l'o = 3.2512 ^ 

Po = . 48ll 

P*0 * -.2462^ 

The Relaxation Method 


The relaxation method requires first the calculation of the 
19 col umn s displayed in table I. Further calculation may be necessary, 
but it is well to stop here and calculate Mo, M i 0 , Mz» 0 , M^ 0 , and M(3‘ 0 . 
If either Mg Q or Mg» Q is the largest of the four derivatives, no more 
columns will have to be computed. If, however, M^» Q is the largest 
derivative, one more column must be foundj whereas if Mj 0 is the 
largest two more must be found. Referring to equations (27), it may be 
seen that is the largest of the four derivatives. Calculating 
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columns 20 and 21 of table II and using equations (20) and (27)* it may 
be seen that 

A 2 - -0.0255 

or that the new approximation to 2 is 

2o - -1.1915 

The Taylor’s Series Method 

With circled numbers referring to columns in table I, it may be 
seen that equations (21) become 

A2 £ @) S - A2» £@ X@ + A0 E ® X @ - Ap* £ ® X © = 

- S @ X @ 

- A2 E @ X (g) + A2’ Z 0) fi -ApE®X0+Ap J Z®X© = 

S0 X 0 " 

AJ E ® x @ - Al' E® X @ + Ap E ® S - AP’ E ® X ® * 

- E® X @ 

- A2 Z ® X © + AZ’ E0 X® -ApE®X®+Ap’E 0 2 - 

X © 

Inserting the values of these sums found in table I and solving 
the resulting equations, 

A2 = -0.2089 
A2’ => -.1680 

Ap = .1353 

Ap’ = .0139 . 

Also, the new approximations are 

l 0 = -1.3749 ' 

I ’o = 3-1020 

Po = -5969 

P’o = -.2311 . 
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Final Values of the. Parameters 


Calculation of 2, V , and g* .- Repeated application of any of 
the methods yields the following values of the parameters to about 
three significant figures: . 

2 =* -1.386 

V = 3- 071 

( 28 ) 

p = ,6lkl 

p» = -.2083 . 

These values of the parameters give, finally, 

M = O.OOO895 (29) 

Calculation of the stability parameters .- The stability parameters 
b, k, Ci, and C Q of the test airplane from which the data of the pre- 
vious example were measured will now be calculated. Using the values 
of 2 and 2 ’ given in equations ( 28 ) and applying equations (23), 
it may be seen that 


b = 2.732 \ 
k = 11.30 J 


In order to find C x and Co by the method described, it is neces- 
sary to find the functions e“^ 8 (t) cos 2 ’t and e“ 2 t 8 (t) sin 2 *t and 
to integrate with respect to t to find aj. and o^’, respectively. The 
functions crj^ and (%* were found by means of a planimeter, utilizing 
figure 1 (see table V). Applying equations (25 ) y and allowing the cir- 
cled numbers to refer to the columns in table Y, it is seen that 


X ft- <1 


Applying the least-squares principle, the following equations are 
obtained: 

■* 

~~ X Z @ E - = S@X@ 


- S 2 2(53) X (s& + -2a 2 (2§) 2 


- S (28) X 
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Thus, utilizing the sums displayed in table V, 


or, recalling that 2* 


£2 = 
2* 

- 12 . 31 * 

Ci 

V 

5.17 

3 . 071, 


C c * 

-37.90 

Cl * 

15.88 


EVALUATION OF THE METHODS AND DEVICES, 
FOE ACCELERATING CONVERGENCE 


Before evaluating the methods, it is necessary tc give the time 
required tc apply each of than. The following table presents the number 
of hours required for one application of the corresponding method, 
including a check. The time required for a single application without 
the check is roughly three-fourths of the total time given in the follow- 
ing table: 


Time Required for a Single Application ! 

| of the Methods j 

Method 

i 

Time 

required j 
(hours) j 

Steepest descent along a tangent 

3 | 

| 

Booth's method 

c r 

6 i 

! Steepest descent to a minimum 

l 


Taylor ’ b series method 

4 ! 

1 

Relaxation method 




Two applications or the Taylor *s series method gave a value of 
M = 0.000695* Three; applications of the method of steepest— descent tc 
a minimum and of Booth's method are required to obtain correspondingly 
small values of M. The value of M obtained after three applications 
of Booth's method is slightly smaller than that given by the other two 
methods; however, aE is indicated by the following evaluation, it is not 
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believed that this swan added benefit merits the additional labor 
involved in Booth* s method. The total time required for the Taylor’s 
series method to bring the value of M down to the value given by 
equation ( 29 } is 11 computer hours j for the method of steepest descent 
to a minimum , 19 hours were needed} whereas Booth's method required 
2k hours. 

The time of 3-1/4 hours given above for a single application of 
the relaxation method does not tell the complete story. It should be 
realized that in a second iteration by means of the relaxation method 
many of the columns and sums vhich are needed are Identical with the 
corresponding columns or sums in the previous iteration and thus need 
not be computed. For example, in fitting a sum of two exponentials, if 
one iteration changes . 3’ (say), only 7 out of 21 columns must be recal- 
culated at the next iteration. Thus, although 10 iterations are required 
to reduce the value of M to approximately the value given in equa- 
tion ( 29 ), 20 hours are required for the job. 

Two further points should be made before an evaluation is applied 
to the above methods. First, it should be noted that the amount of work 
required to solve a given problem by the method of steepest descents 
increases very rapidly with m (where, as before, m is the number of 
parameters considered in the problem), due to the necessity for calcu- 
lating all, second derivatives of M with respect to the parameters . 

The rate of increase of hours of labor for the Taylor* s series method, 
while not as rapid as for this last method, Is still quite high. On the 
other hand, the amount of labor required to apply the relaxation method 
or Booth’s method increases relatively slowly with m. 

Finally, It should be realized that there are many devices avail- 
able for accelerating the convergence of the iteration process. These 
devices became evident as familiarity with the methods increases. It is 
important to understand that any method, however irregular. Is to be 
considered applicable provided only that the value of M Is made to 
decrease. Such a device, for example. Is the following. Suppose 
repeated, application of one of the methods shows that the sign of the 
increments to be added to one of the parameters is always the same. A 
device which Is often applicable in this case would be to increase the 
value of the increment found at some Iteration. Conversely, If the 
signs of some increments change at successive iterations, it may be 
found advisable to use an Increment not quite as large as that indicated 
by the method used. For a further discussion of these accelerating 
devices, see reference 8. 

Due to the fact that the relaxation method varies only one param- 
eter at a time, the computer is more aware of what is being accomplished 
at each Iteration when applying this method than when applying the other 
methods. This, in turn, makes it easier to devise and apply "tricks" 
like the two described above for accelerating convergence when applying 
the relaxation method than when applying the other methods. This is 
particularly true when the number of parameters Is large. 
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Taking all these factors into account the .following conclusions 
would appear' to be valid:. 

1. If the number of parameters is less than five or six, the 
Taylor’s series method seems very well adapted to solving the problem. 
The method of steepest descent to a minimum also may be applied success- 
fully, but more time is required for the minimization. Further, the 
type of computations used in the method of steepest descent to a mini- 
mum, being difficult to systematize, is peculiarly subject to numerical 
error on the part of the computer. Both the relaxation method and 
Booth’s method- also require more time than the Taylor’s series method 
and are not as well suited to the solution of the problem as either of 
the other two methods. 

2. If the number of-parameters exceeds six, either Booth’s method 
or the relaxation method may be applied successfully. Since Booth’s 
method varies all of the parameters together rather than changing only 
one at a time as does the relaxation method, the former is to be 
preferred, except if it is desired to allow the computer to apply’ his 
own discretion to increase the rapidity of the convergence. 

Only one more thing remains: the evaluation of the method of damped 
least squares. It should be remembered that this method was devised for 
the purpose of solving problems for which the Taylor’s series method 
fails to converge. In the application of this method, the weighting 
factors w and w^ which occur in equation (Hd) must be found at each 
iteration, thus adding further calculations to an already imposing array 
Also, there are several devices which- may be applied which remove the 
need for such a method with its attendant complications . First, one of 
the other methods described may not fail to converge and may be applied 
in place of the Taylor’s series method. In particular, the method of 
steepest descent along a tangent may be used followed by applications 
of the Taylor’s aeries method. Second, a new first approximation may be 
found from which the Taylor’s series method or one of the other methods 
may converge. Finally, one of the devices mentioned above for increas- 
ing the rapidity of convergence may often do more than this: these 
methods frequently will cause a method to converge where it diverged 
before. It is believed that intelligent use of these three devices can 
take the place of the method of danped least squares. 
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CONVERGENCE TCL.A MERE STATIONARY POINT 
AS OPPOSED TO A TRUE MINIMUM 


To review, what has been done thus far is the following: 
point P, (xi^ \ 'x.J' ^ ... , has been found such that 


— ( v (°) x (°) x^ 0 ^ - O k- 1 2 

i V Jt l > x 2 **’ * TI / — u ~ ••• i 


m 


The possibility that higher derivatives of M are also zero at P haB 
not entered the discussion. A point at which al 1 the first and second 
derivatives of M are zero may be called a stationary point, as opposed 
to a true extremum (max imum or minimum) at which some of the second 
derivatives of M are not zero, (if M were a function of one variable, 
say x, alone, a stationary point would be a point of inflection at 
which dM/dx =0.) This section will be devoted to a criterion for 
determining whether the iteration processes have converged to a true 
minimum or to a stationary point. 


Let M^ 0 ) be the value of M at (x^/ °\t x 2 (°), ... > . 

Let Mi j be the value of r-r- at (xx^), ... , x^ 0 ))- In refer - 

dXidXj 

ence L, Booth shows that if M^°^ is a true minimum, the quadratic form 

m 

Q " X 


is positive definite, while it is well known (see, e.g. , reference 10, 
p. 137) that the form Q is positive definite if and only if the fol- 
lowing conditions hold: 


\ 




Mu 


|Mh 

Mia 


Mai 

m 2 * 

Mu 

Mia 

M 13 

Msi 

“sa 

Mas 

“si 

Maa 

Mas 


0 

0 


( 30 ) 




m 


> 0 
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In general, for curve-fitting problems conditions (30) do not have 
to be applied since the curve q *= q(t) may be plotted and compared 
with the curve q = q € (t), and it will usually bte made clear whether or 
not a minimum has been reached. There are cases,, however, where this Ja 
not so clear; ‘in these cases, the conditions (30) may be inroortant. 

If it has been discovered that the minimization procedure has led 
to a stationary point rather than a true minimum, the means by which 
this difficulty may be overcome are not straightforward and a good dead, 
of ingenuity may be required. The problem is, actually, similar to 
the problem of increasing M which was discussed above. Such devices 
as finding new first-approximations, applying one of the other methods, 
etc., may be used. In particular, when finding new first approxima- 
tions, choosing them farther in the same direction as the parameters 
were going when converging from the old approximations to the station- 
ary point will often be fruitful. ...... 


USES OF THE METHODS OTHER THAN CURVE FITTING 


The problem of curve fitting a nonlinear function has been dis- 
cussed at length, but it has hardly been mentioned that there are other 
important uses for the methods discussed herein. These applications 
will be briefly discussed in the present section. 

The first application. is evident; the method may be applied to any 
minimization problem besides curve fitting. Such a problem arises in 
connection with guided missiles, for example. There are certain param- 
eters of the missile and its control system (servo gain, time constants, 
etc.) which are— susceptible to adjustment; such an adjustment is sought 
which minimizes the miss distance. 

A second type of problem is one which frequently arises in applied 
mathematics. It may be generally described by saying that it includes 
any problem which may be reduced to a minimization problem. For example, 
consider the set of equations 

, x m ) — -0 

... , Xm ) — 0 

^n ( x * > ^m ) = 0 

« 

which are to be solved simultaneously, (it should be noticed that m 
does not have to equal n. The definition given below of a ’’solution" 
of equations (31) includes the possibility m = n as a special case.) 
Equations (31) may or may not be linear. This problem may be reduced 
to one of minimization by defining a solution of equations (. 31 ) as any 
set of values of x x , ... , x m which minimize. 


(31) 
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EL 



Tnis definition evidently includes the case where equations (31) have a 
solution in the classical sense. A numerical example of this type of 
problem follows. 

Consider the set of two equations 

x x = sin x 2 
Xi + x 2 = 1 

These may be solved by minimizing 

M = (x x - sin x 2 ) e + (xi+Xg-l) 2 
Letting M-, = Mg = we have 

a Xl dx 2 

M x = 2(2x 1 +x 2 -l- sin x 2 ) 

„ r/ . sin 2x=\ 

M 2 = 2f Xj+Xg-l-Xi cos Xgf - — 

Bather than obtain first approximations by some cumbersome graphi- 
cal method, xi = xg = 0 may be arbitrarily taken as an approximation 
and the method of steepest descent along a tangent (equations (14) ) 
applied. 

If zero subscripts denote the value of M and its derivatives at 
the first approximation xi 0 = xjg 0 = 0, 

Mo = 1. 

M 1q = -2 
M 2q = -2 

Applying equations (14) , 

AXi = | = 0.25 
Ax a = | = .25 

Changing notation so that zero subscripts refer to the new approxi- 
mations 
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Xi Q = 0.25 1 
x 2q - .25/ 


we obtain 

M 0 = (0.0026) 1 2 + (0.5 f = 0.25 ' 

Mi Q = 2( -0.4974) = -0.9948 
Mg 0 = 2(-0.0025) = - 0.005 

Therefore, again using equations (14), 

AXi = 0.2513 •} 

Ax 2 = .0013/ 

and, again changing notation, 

x lQ « 0.5013 \ 

x 2o = .2513/ - . 

This method may be cdntinued until M increases, and it may be followed 
by applications of one of the other methods. 

Another common problem which may be BOlved is the solution of 
polynomial equations (or, for that matter, other types of equations). 
This problem is, of course, the special case of the preceding problem 
which occurs when m = n = 1. Thus, the equation 

<p(x) = 0 

may be solved for x by minimizing 

M = [9(x)f 


CONCLUDING REMARKS 


Several methods for curve fitting a nonlinear function by least 
squares have been described. If the number of parameters which may be 
varied in any problem to obtain the best fit for a set of data be denoted 
by m, the evaluation leads to the following conclusions: 

1. In general, the method of steepest descent along a tangent 

should be first applied to the first approximations. _ 0ne_of- the finer 
methods should then be used to improve the parametric values obtained by 
this method. 
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2. The method of -steepest descent to a minimum, while theoret- 
ically quite good, is rather long, the length of time required for a 
single iteration increasing rapidly with m, the n umb er of parameters. 

For this reason, the method may be applied successfully if m is not 
greater than four or fivej it is too cumbersome for higher order systems. 

3. The Taylor’s series method is somewhat better than the method 
of steepest descents from the point of view of speed and accuracy. The 
method is very well suited to problem a in which m is less than five 

or six. It has the disadvantage of requiring the solution of a set of m 
simultaneous equations at each iteration, and thus may grow awkward for 
large m. 

4. The relaxation method requires less time for a Bingle iteration 
than any of the other methods. However, not as much is achieved per 
iteration. More precisely, while the other methods described improve 
the values of a.l l the parameters at each iteration, the relaxation 
method changes only one parameter at a time. This disadvantage also 
has a compensation, however, in that a greater feel for what is being 
accomplished at each step is to be had. That is, the computer may use 
more of his own discretion and intelligence to improve the convergence. 
The relaxation method is well adapted to systems with large (i.e., 
greater than 6) values of m. 

5. The amount of labor required for Booth’s method, along with 

the relaxation method, increases relatively slowly with m. Thus, 
either Booth’s method or the relaxation method may be applied If the. 
number of parameters Is large. » 

6. One further method, the so-called method of damped least 
squares, is discussed in the body of the report. This system was devel- 
oped for use in cases where the Taylor’s series method failed to converge 
It might seem, however, that other devices, finding new first approxima- 
tions, application of one of the other methods, under- or over-relaxation 
and so forth, eliminate the need for any such method. 


1 
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These conclusions may thus be finally summed up as in the following 
table; 


Method 

Evaluation 

Steepest descent 
along a tangent 

A rapid method for improving first 
approximations. Should be used on all- 
prob leans unless it is definitely known 
that these approximations are very good 

Taylor’s series 
method 

This appears to be the best method to 
apply if the number of parameters is less 
than five or six 

Steepest descent to 
a minimum 

Rather cumbersome, but may be applied 
successfully if the number of parameters 
does not- exceed four 

Relaxation method 

Useful if the number of parameters exceeds 
six 

Booth ' s method 

This method appears best if the. number of 
parameters is very much greater than eight. 
If m is between six and eight. Booth’s 
method and the relaxation method appear to 
be equally useful 

Damped least squares 

Devices described above would appear to 
eliminate the need for any such method 


Ames Aeronautical Laboratory, 

National Advisory Committee for Aeronautics, 
Moffett Field, Calif., Oct. IT, 1951. 
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TABLE II.- THE METHOD OF STEEPEST DESCENT TO A MINIMUM 
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TABLE III.- BOOTH'S METHOD; CALCULATION OF M a 
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TABLE IV.- BOOTH'S METHOD} CALCULATION OF M 
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-.0032 

-.0110 

.008 

.oil 

-.003 

23 

2.6 

-3.2266 

• 0397 

8.3320 

-.4600 

.8879 

-.0183 

.0352 

-.0084 

-.0088 

0 

,008 

-.008 

24 

2.7 

-3.3507 

.0350 

8.6524 

-.7163 

.6978 

-.0251 

.0244 

-.0115 

-.0061 

-.005 

.005 

-.010 

25 

-2.8 

-3.4748 

.0310 

8.9729 

-.8996 

.4366 

-.0279 

.0135 

-.0128 

-.0034 

-.009 

.003 

-.012 

26 

2.9 

-3.5989 

.0274 

9.2933 

-.9914 

.1311 

-.0272 

.0036 

-.0125 

-.0009 

-.012 

.001 

-.013 

27 

3.0 

-3.7230 

.0242 

9.6138 

-.9822 

-.1879 

-.0238 

-.0045 

-.0109 

.0011 

-.012 

0 

-.012 

28 

3.1 

-3.8471 

.0213 

9-9343 

-.8730 

-.4877 

-.0186 

-.0104 

-.0086 

.0026 

-.011 

0 

-.011 

29 

3-2 

-3.9712 

.0189 

10.2547 

-.6750 

-7379 

-.0128 

-.0139 

-0059 

.0035 

-.009 

0 

-.009 

£ @ 2 = 0.0036 
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TABLE V.- COMPUTATIONS REQUIRED FOR THE CALCULATION OF C x AND C 0 


5 


1 

2 

3 

* 

5 

6 

7 

8 

9 

10 

J 1 

.. 12 

13 

1* 

15 

16 

17 

18 

I 

\ 

8(1*) 

e -M* 

eg* l't* 

BBS 

©x® 

®x® 

a>x© 

m 

»k 

D 

a 

(T 1 - 0^ 


& 

® 

©x© 

mm 

1 

0. 

.05 

.10 

.15 

.20 

.25 

.30 

'-35 

.*0 

0 

.OOJ 

.0*5 

.105 

.125 

.100 

.030 

0 

0 

l| 

1.000 

.980 

.953 

.09 6 
.ai7 
.719 
.605 
.*76 
.336 

0 

.153 

.302 

.**? 

■576 

•695 

.796 

.880 

•9*2 

1.000 

1.05a 

1.093 

1.099 

1.07* 

1.012 

.911 

.768 

.380 

0 

.16* 

.3*7 

.5*6 

.757 

•977 

1.200 

l.*19 

1.627 



0 

.001 

.016 

.057 

.095 

.098 

.036 

0 

0 : 

0. 

.00005 

.00126 

.0053* 

.00176 

.01812 

.02132 

.02172 

.02172 

0 

.00001 

.00030 

.00020 

.00596 

.01066 

.00*20 

.01*96 

.01*96 

0.02172 

.00167 

.000** 

.01638 

.00996 

.OO36Q 

■.000*0 

0 

0 


1.000 

.923 

.832 

.730 

.622 

■:E 

■295 

■195 

0 

.1*3 

.26* 

.363 

.*38 

.5*6 

.3*5 

0^1*98 
.01380 
.01021 
.00933 
. .00560 
.00210 
.00030 

0 

0 

[flip wyw« 

1 T T 1 — 1 1 — — —r 


1 






19 


21 

22 

23 

2* 

25 

26 

07 

28 

29 

30 

31 

32 

33 

9 

<s>-@ 


©X l 


@x© 

@x l> 

©x 1 




©X p 

©x p> 

jflllll 

'fe(tk) 


§ 

0.01*96 

.01072 

.00681 

.00336 

.0012* 

.00032 

.00009 

0 

0 

0.06670 

.06655 

.06077 

.05030 

.03059 

.01106 

.00123 

0 

0 

-0.000*6 

-.020*5 

-.02005 

-.017*6 

-.01229 

-.00560 

-.0010* 

0 

0 

0.08P6 

.08700 

.08262 

.09776 

.0*288 

.00666 

.00227 

0 

0 

0.00716 

-08030 

.06891 

..0*9*5 

. .02667 
.00851 
.00091 

0 

0 

0.0*600 

.0*597 

.0*508 

.03925 

.0076* 

.00259 

.00233 

0 

0 

-0.02967 

-.02960 

-.02792 

-.02238 

-.01361 

-.00*90 

-.00055 

0 

0 

O.CEI633 
.01637 
.01716 
.01687 
.01*03 
.00767 
.00178 
0 ■ 

0 

0 

.0023* 

.00*53 

.00612 

,00613 

.00379 

.0009* 

0 

0 

0.0&716 

.0826* 

.073** 

.05558 

.03282 

.0(1230 

.00185 

D 

0 

0.61* 

•567 

.511 

.**8 

.382 

.31* 

.2*6 

.181 

.120 

0 

-.030 

-.055 

;-.076 

-.091 

-.103 

-.110 

-.11* 

-.11* 

0.61* 

.597 

.566 

.52* 

.*73 

.*17 

.356 

.095 

.23* 

0. 

.008 

.095 

.200 

.310 

.360 

.320 

.272 

■2^ 

-O.dl* 

-589 

-.*71 

-.32* 

-.163 

-.057 

-.036 

-.023 

-.aio 


£ ©' - 0.0003968 


I i 1 C @ @ - 0.00392* I 

z © <§> " -o-oax* 

£ ©* - 0 . 00 * 1 * 

£ © © - -0.1609 


k 
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Time, t, sec 


(a) e lf 8(t) cos ft 


(b) ob ( t) sin l’t 


Figure /.- The variation with time of two quantities required for the calculation 

of C, and C n . 



